An Information— Theoretic Equality Implying the Jarzynski Relation 
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We derive a general information-theoretic equality for a system undergoing two projective mea- 
surements separated by a general temporal evolution. The equality implies the non-negativity of 
the mutual information between the measurement outcomes of the earlier and later projective mea- 
surements. We show that it also contains the Jarzynski relation between the average exponential 
of the thermodynamical work and the exponential of the difference between the initial and final 
free energy. Our result elucidates the information-theoretic underpinning of thermodynamics and 
explains why the Jarzynski relation holds identically both quantumly as well as classically. 



The sole purpose of this letter is to derive a simple information-theoretic equality for a general quantum mechanical 
process that involves a state preparation (by a projective measurement), follovifed by a general quantum evolution of 
the system, and finally concluded by executing another projective measurement. This scenario is completely general 
and effectively captures any question that can be posed within the formalism of quantum physics. We introduce no 
[ — ■ other constraints for the time being. To make our analysis quantitative, let us start in the state p, and let us label 
the basis of the first measurement {Pn}- The ensuing evolution will be given by the most general completely positive, 
trace preserving map, Ai(-)A|. The basis of the final measurement will be {Qm}- The main quantity, from which 
' all other physically relevant quantities can be derived, will be the joint probability p{n, m) that the system is initially 
O I projected onto the state Pn and then also projected onto the state Qm in the final measurement. It is given by the 
I ' . Born rule 

(73 : P{n, m) = tr{Qm A^PupPn^lQ^} - trQ„(^ A,P„AJ) x tr{Pnp) . (1) 

O^' . 

This formula can be understood as a simple expression of the usual probabilistic chain rule p{n,m) — p{m\n)p{n), 
where 

^ ; P(n) = tr(Pnp) (2) 

^^O is the probability for the nth outcome in the first measurement, while 



p(m|n) =irQ™(^A,;P„A|) (3) 

is the conditional probability that the second measurement will yield the outcome m if the first measurement was n. 
The key quantity in our equality will be the mutual information [l[ between P„ and Q™, denoted by /„„i, which we 
now proceed to define as 



Inm = ~ Inp(TO) + lnp(m|n) , (4) 

, where p(jn) = — tfQm^ipAi- The interpretation of this quantity is simple. In the single realisation of 

our experiment, when the measurement outcomes are first Pn and then Q™, the mutual information tells us about 
the difference between the entropy of the mth outcome without the knowledge of n (given by — Inp(n)) and the mth 
outcome when n is known (given by — lnp(m|n)). This quantity measures correlations between two measurements and 
is symmetric under the exchange of the two measurements (which is why temporal labeling is actually superfiuous) . 
The information-theoretic equality presenting our main result can now be stated as: 



nrrt 



Expressed in words, the average of the exponential of the single trial mutual information between the preparation 
and measurement on a system free to evolve in a general way between the two, always equals a unity. 

The proof of the above equality is simple. By substituting the expression of into the above formula we obtain 



yp(n,m)e-^"" = V p(n, m)e^"P(")-'"P("l") =Ypin,m) = V p(n) x p(m) = V p(n) x Vp(m) = 1 

^-^ ^-^ ^-^ p\m\n] ^-^ ^-^ ^-^ 

(6) 
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Therefore, following this chain of equalities backward, we can conclude that our information-theoretic equality is a 
simple expression of the conservation of probability. 

We conclude by presenting two consequences of the above equality. The first is that the equality implies the non- 
negativity of the total mutual information X]nmP('^' — ^ (and is therefore a stronger statement), which just 
follows from the convexity of the exponential function. This may seem like a trivial statement, however, it contains 
insightful results. For instance, the state p can be thought of as being bi-partite, and the first and last measurements 
could contain projections on both subsystems. Our equality could then be applied to the trade-off between the mutual 
informations between subsystems and the sum of the entropy changes of the subsystems (see the Maxwell's demon 
discussion in [2]). 

The second implication of our equality is the Jarzynski relation. For this we need to assume that the initial state p is 
a Gibbs state of the form p — exp{—(3H} jZ where Z — tr exp{— /3iJ} is the partition function and R — ^„ E^Pn (as 
usual /3 = k being Boltzmann's constant and T the temperature). Secondly, the basis of the first measurement 

is the same as that of H (and therefore of p). Thirdly, the evolution is generated by a Hamiltonian H' = E'„^Qm 
and the second measurement is performed in the basis of H'. Then it can be shown that the mutual information 
can be written as /„„ = P{En - E'^) - /3(F' - F) where F = -kT\nZ and F' = -kTlnZ' are the initial and the 
final free energies and Z' = tr exp{—/3H'} is the final partition function (here we assume the same initial and final 
temperatures for simplicity, but without any real loss of generality). Therefore, our information-theoretic equality 
can now be written as 

(e-^-) = (e''(^"-^™)-^(^'-^^)) = 1 . (7) 

which is, in fact, the quantum version of the Jarzynski equality Interestingly, this allows us to interpret the 

quantity /?(£'„ — E'^^^) — P{F' — F) (energy change minus free energy change between two measurements) as the mutual 
information, and therefore correlation, between the past and future measurements (or between the initial preparation 
and the final measurement). 

In summary, we have presented a very general equality involving the exponential of the mutual information whose 
validity rests purely on the simple properties of classical probabilities. We have demonstrated its power by showing 
that it implies a (restricted) version of the quantum Jarzynski equality (the fact that even though we considered 
a general quantum setting all that mattered were classical probabilities explains why the Jarzynski equality is true 
both in quantum as well as in classical physics). It will not be difficult to demonstrate that more general scenarios, 
including errors and feedback (i.e. cases where As become dependent on n), can also be shown to follow from the 
presented information-theoretic equality, a task we leave to subsequent investigations. 
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